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Abstract. Let Y — G/H be a semisimple symmetric space. It is 
shown that the smooth vectors for the regular representation of G 
on L P (Y) vanish at infinity. 
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1. Vanishing at infinity 

Let G be a connected unimodular Lie group, equipped with a Haar 
measure dg, and let 1 < p < oo. We consider the left regular represen- 
tation L of G on the function space E p = L P (G). 

Recall that / G E p is called a smooth vector for L if and only if the 
map 

G — > E p , g^L(g)f 

is a smooth valued map. 

Write g for the Lie algebra of G and U for its enveloping algebra. 
The following result is well-known, see [3]. 

Theorem 1.1. The space of smooth vectors for L is 

E™ = {fe C°°(G) | L u f e L P (G) for all u e U(g)}. 

Furthermore, E™ C C^(G), the space of smooth functions on G which 
vanish at infinity. 

Our concern is with the corresponding result for a homogeneous 
space Y of G. By that we mean a connected manifold Y with a tran- 
sitive action of G. In other words 

Y = G/H 

with H C G a closed subgroup. We shall request that Y carries a 
G-invariant positive measure dy. Such a measure is unique up to scale 
and commonly referred to as Haar measure. With respect to dy we 
form the Banach spaces E p := L P (Y). The group G acts continuously 
by isometries on E p via the left regular representation: 

[L(g)f](y) = fig-'y) (g e G,y eY, f e E p ) . 

We are concerned with the space E^ of smooth vectors for this repre- 
sentation. The first part of Theorem 11.11 is generalized as follows, see 
[3], Thm. 5.1. 

Theorem 1.2. The space of smooth vectors for L is 

E™ = {fe C°°(Y) | L u f G L p (Y) for all u G U(g)}. 

We write C^°(Y) for the space of smooth functions vanishing at 
infinity. Our goal is to investigate an assumption under which the 
second part of Theorem 11.11 generalizes, that is, 

(1.1) E? C C™(Y). 

Notice that if H is compact, then we can regard L P (G/H) as a 
closed G-invariant subspace of L P (G), and (11. ip follows immediately 
from Theorem 11.11 
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Likewise, if Y = G regarded as a homogeneous space for G x G with 
the left x right action, then again (11.11) follows from Theorem ll.il since 
a left x right smooth vector is obviously also left smooth. 

However, (II. II) is false in general as the following class of examples 
shows. Assume that Y has finite volume but is not compact, e.g. 
Y = Sl(2, R)/S1(2, Z). Then the constant function ly is a smooth 
vector for E p , but it does not vanish at infinity. 

2. Proof by convolution 

We give a short proof of (11.11) for the case Y = G, based on the 
theorem of Dixmier and Malliavin (see [2]). According to this theorem, 
every smooth vector in a Frechet representation (n, E) belongs to the 
Garding space, that is, it is spanned by vectors of the form n(f)v, 
where / G C%°(G) and v G E. Let such a vector L(f)g, where g G 
E p = L P (G), be given. Then by unimodularity 



For simplicity we assume p — 1. The general case is similar. Let HcG 
be compact such that \g\ integrates to < e over the complement. Then, 
for y outside of the compact set supp/ • Q, we have 



It follows that L(f)g G C (G). 

Notice that the assumption Y = G is crucial in this proof, since the 
convolution identity (12.11) makes no sense in the general case. 

3. Semisimple symmetric spaces 

Let Y = G/H be a semisimple symmetric space. By this we mean: 

• G is a connected semisimple Lie group with finite center. 

• There exists an involutive automorphism r of G such that H 



is an open subgroup of the group G T = {g G G \ r(g) = g} of 
r-fixed points. 



We will verify (11.11) for this case. In fact, our proof is valid also under 
the more general assumption that G/H is a reductive symmetric space 
of Harish-Chandra's class, see [TJ . 



(2.1) 




yx G supp/ =^ x Q, 



and hence 
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Theorem 3.1. Let Y = G/H be a semisimple symmetric space, and 
let E p = L p (Y) where \<p<oo. Then 

C C™{Y). 

Proof. A little bit of standard terminology is useful. As customary 
we use the same symbol for an automorphism of G and its derived 
automorphism of the Lie algebra g. Let us write $j = h + q for the 
decomposition in r-eigenspaces according to eigenvalues +1 and —1. 

Denote by K a maximal compact subgroup of G. We will and may 
assume that K is stable under r. Write 9 for the Cartan-involution 
on G with fixed point group K and write g = 6 + p for the eigenspace 
decomposition of 0. We fix a maximal abelian subspace a C p fl q. 

The simultaneous eigenspace decomposition of q under ad a leads to 
a (possibly reduced) root system £ C a*\{0}. Write a rcg for a with the 
root hyperplanes removed, i.e.: 

flreg = {X G a I (Va G S) a{X) ^ 0} . 

Let M = Z HnK (a) and W H = N HnK (a)/M. 

Recall the polar decomposition of Y. With y = H e Y the base 
point of Y it asserts that the mapping 

p : K/M xa^Y, (kM, X) h-> k exp(X) • y 

is differentiable, onto and proper. Furthermore, the element X in the 
decomposition is unique up to conjugation by Wh, and the induced 
map 

K/M x Wh o rcg -»• Y 

is a diffeomorphism onto an open and dense subset of Y. 

Let us return now to our subject proper, the vanishing at infinity of 
functions in Ei* 3 . Let us denote functions on Y by lower case roman 
letters, and by the corresponding upper case letters their pull backs to 
K/M x a, for example F — f o p. Then / vanishes at infinity on Y 
translates into 

(3.1) lim sup \F(kM,X)\ = 0. 

We recall the formula for the pull back by p of the invariant measure 
dy on Y . For each a G £ we denote by g a C the corresponding 
root space. We note that g a is stable under the involution 0t. Define 
p a , resp. q a , as the dimension of the #r-eigenspace in g a according to 
eigenvalues +1,-1. Define a function J on o by 



J(X) 



I [ [cosha(X)] fe • [sinha(X)] p " 

oes+ 
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With d(kM) the Haar- measure on K/M and dX the Lebesgue- 
measure on o one then gets, up to normalization: 

p*(dy) = J(X) d(k,X) := J(X) d(kM)dX. 

We shall use this formula to relate certain Sobolev norms on Y and 
on K/M x a. Fix a basis X 1: ...,X n for g. For an n-tupel m = 
(mi, . . . , m n ) G Nq we define elements X m G W(g) by 

j^m X mi • • X mn 

These elements form a basis for 14(g). We introduce the L p -Sobolev 
norms on Y, 

i/p 



S m ,n(f) ■= E 

m|<m 



/ \L(X™)f(y)\ p dy 



where Q C Y, and where |m| := mi + . . . + m n . Then / G if and 
only if S mt Y(f) < oo for all m. 
Likewise, for V C a we denote 

r r i 1/p 

S* m ,v(F):= J2 / l^(^ m )^M,X)rj(X)rf(A;,X) 

|m|<m Uk * V J 

Here Z refers to members of some fixed bases for t and a, acting from 
the left on the two variables, and again m is a multiindex. 
Observe that for Z G a we have for the action on a, 

[L(Z)F](kM,X) = [L(Z k )f](kexp(X)-y ) 

where Z k := Ad(k)(Z) can be written as a linear combination of the 
basis elements in g, with coefficients which are continuous on K. It 
follows that there exists a constant C m > such that for all F — f o p, 

(3.2) S* my (F) < C m S m , n (f) 

where Q = p(K/M, V) = K exp(V) ■ y . 
Let e > and set 

a e := {X G a | (Va G S) \a(X)\ > e} . 

Observe that there exists a constant C e > such that 

(3.3) (VX G a e ) J(X) > C e . 

We come to the main part of the proof. Let / G E£°. We shall first 
establish that 

(3.4) lim F(eM,X) = 0. 

X— >oc 
XGa € 
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It follows from the Sobolev lemma, applied in local coordinates, that 
the following holds for a sufficiently large integer m (depending only 
on p and the dimensions of Kj M and a) . For each compact symmetric 
neighborhood V of in o there exists a constant C > such that 



\F(eM,0)\ 



(3.5) 



|m|<m 



\[L(Z m )F}(kM,X)\ p d(k,X) 



K/MxV 



for all F G C°°{K/M x a). We choose V such that a e + V C a e/2 . 

Let 5 > 0. Since / G i? p , it follows from (13. 2p and the properness 
of p that there exists a compact set B C a with complement _B C C a, 
such that 



(3.6) 



S* m>Bc (F)<C m S m , u {f)<S 



where Q = K exp(£> c ) • y - 

Let Xi G a e n {B + V) c . Then Xi + X e a e/2 n B c for X G V. 
Applying (13. 5p to the function 

Fi(kM, X) = F(kM, Xi + X), 

and employing (13.31) for the set a e / 2 , we derive 

\F(eM,X 1 )\ 



|m|<m 
|m|<m 



| [L{Z m )Fi] (kM, X) \ p d(k, X) 



i i/p 



A'/MxV 



| [L{Z m )F] {kM, X) \ p J(X) d(Jfe, X) 



K/MxB c 



1/p 



= C'S^ BC (F)<C5, 

from which (13.41) follows. 

In order to conclude the theorem, we need a version of (13.41) which 
is uniform for all functions L(q)f, for geQcGa compact subset. 

Let 5 > be given, and as before let B C a be such that (13.61) holds. 
By the properness of p, there exists a compact set B'co such that 

QKeMB)-y CKexp(B')-y Q . 

We may assume that I?' is W-^-invariant. Then, for each k G K, 
X ^ B' and q E Q we have that 



(3.7) 



g x A;exp(X) • y £ K exp(B) ■ y , 



FUNCTION SPACES 



7 



since otherwise we would have 

kexp(X) ■ y G qK exp(B) ■ y C K exp(B') • y 

and hence X G B' . 

We proceed as before, with B replaced by B', and with /, F replaced 
by f q = L q f, F q = f q o p. We thus obtain for X 1 ea e C\ {B' + V) c , 

\F q (eM,X 1 )\ < CS* mt{B , )c (F q ) < CC m 3 m>{V (f q ) 

where Q' = K exp((_B') c ) ■ y . 

Observe that for each X in q the derivative L(X)f q can be written 
as a linear combination of derivatives of / by basis elements from q, 
with coefficients which are uniformly bounded on Q. We conclude that 
S m ,n'(f q ) is bounded by a constant times S mj Q-iQ/(f), with a uniform 
constant for q G Q. By ( 13.71) and f)3.6p we conclude that the latter 
Sobolev norm is bounded from the above by 5. 

We derive the desired uniformity of the limit (13.41) for q G Q, 

(3.8) lim sup \FJeM,X)\ = 0. 

Finally we choose an appropriate set Q. Let e > be arbitrary. 
There exists Xi, . . . , X N G a such that 

N 

(3.9) a={J(X J + a t ). 

3=1 

Set dj = exp(Xj) G A and define a compact subset of G by 

JV 

Q := |J Ka 3 . 

3=1 

Then, for every X G a we have X — Xj G a e for some j. Hence with 
q = kexp(Xj) 

lim F(kM,X) = lim F q (eM,X - X,-) = 0, 
as was to be shown. □ 

Remark. Let / G L 2 {Y) be a infinite function which is also finite for 
the center of U(q). Then it follows from [1] that / vanishes at infinity. 
The present result is more general, since such a function necessarily 
belongs to Ef 3 ■ 
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